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1 Introduction 

Second-order conditions are ubiquitous in non-linear optimization, in partic- 
ular playing a central role in perturbation theory and in the analysis of algo- 
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rithms. See for example pill6). Classically, a point x is called a strong local 
minimizer of a function / on R" if there exist k > and a neighbourhood U 
of X such that the inequality 

fix) > f{x) + k\x - holds for ah x e U. 

Here | • | denotes the standard euclidean norm on R". For smooth /, this 
condition simply amounts to positive definiteness of the Hessian V'^f{x). 

Existence of a strong local minimizer is a sufficient condition for a num- 
ber of desirable properties: even in classical nonlinear programming, it typ- 
ically drives local convergence analysis for algorithms. However, this notion 
has an important drawback, namely that strong local minimizers are sensi- 
tive to small perturbations to the function. To illustrate, the origin in R^ 
is a strong (global) minimizer of the convex function f(x,y) — (\x\ + 
whereas strong minimizers cease to exist for the slightly perturbed functions 
jt(x,v) = \y\f + t{x ^ y) for any t ^ 0. 

In light of this instability, it is natural to look for a more robust quadratic 
growth condition, namely we would like the constant n, and the neighbourhood 
[/, appearing in the definition of strong local minimizers, to be uniform relative 
to linear perturbations of the function. 

Definition 1.1 (Stable strong local minimizers) Wc will say that a: is a 
stable strong local minimizer of a function /: R" -> R U {— oo, -|-oo} if there 
is a constant k > and a neighbourhood U oi x so that for each vector v near 
the origin, there is a a point x^ (necessarily unique) in U, with xq = x, so that 
in terms of the perturbed functions /„ := /(•) — {v,x), the inequality 

fv{x) > fv{xv) + n\x — holds for each x in U. 

This condition appears under the name of uniform quadratic growth for tilt 
perturbations in |16j . where it is considered in the context of optimization 
problems having a particular presentation. One could go further and require 
the dependence v i-^ Xy to be Lipschitz continuous, though it is easy to see 
that this requirement is automatically satisfied whenever a; is a stable strong 
local minimizer (see Proposition 12 . 2p . 

In the variational-analytic literature, conditioning and sensitivity of opti- 
mization problems is deeply tied to the notion of metric regularity I141 I51 IT51 I5] . 
For us, the work of Artacho-GeofFroy [1] in this area will be particularly im- 
portant. There the authors considered regularity properties of the workhorse 
of convex analysis, the convex subdifferential mapping x i— ^ df{x), and fully 
characterized such properties in terms of a variety of quadratic growth con- 
ditions. Results of the same flavour also appear in [5]. In this short note, we 
will generalize the equivalence [TJ Corollary 3.9] to all lower-semicontinuous 
functions possessing a natural continuity property. Consequently, we will show 
that for such a function / on R" and a local minimizer x of /, the limiting 
subdifferential df is strongly metrically regular at (x, 0) if and only if / is prox- 
regular at x for (see Definition l2.10[) and x is a stable strong local minimizer 
of/. 
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Our proof strategy is straightforward. We will try to reduce the general 
situation to the convex case, thereby allowing us to apply [Tl Corollary 3.9]. 
The key step in this direction is to observe that stable strong local minimizers 
are tilt-stable, in the sense of |13| . In fact, employing a reduction to the convex 
case, we will establish the surprising equivalence: stable strong local minimizers 
are one and the same as tilt-stable local minimizers fCorollarv l3.2l) . We should 
also note that our results generalize [71 Theorem 6.3], which is only applicable 
to -partly smooth functions possessing a certain nondegeneracy condition. 

As a by-product of our work, we will deduce that there is a complete 
characterization of stable strong local minimizers using positive definiteness of 
Mordukhovich's generalized Hessian d^f{x\0). For more details on the theory 
of generalized Hessians see ^^9, . This is significant since there is now a fairly 
effective calculus of this second-order nonsmooth object [10] , thereby providing 
the means of identifying stable strong local minimizers in many instances of 
practical importance. 



2 Preliminaries 

In this section, we summarize some of the fundamental tools used in variational 
analysis and nonsmooth optimization. We refer the reader to the monographs 
Borwein-Zhu [5], Clarke-Ledyaev-Stern-Wolenski [3], Mordukhovich [5J|H], and 
Rockafellar-Wets [15], for more details. Unless otherwise stated, we follow the 
terminology and notation of |15| . 

The functions that we will be considering will take their values in the 
extended real line R := RU{— cxd, oo}. For a function /: R" — > R, the domain 
of / is 

dom/ := {x G R" : f{x) < -\-oo}, 
and the epigraph of / is 

epi/ := {{x,r) G R" x R : r > f{x)}. 

A function / is lower- semicontinuous (or Isc for short) at x if the inequality 
liminf^^g f{x) > f{x) holds. 

Throughout this work, we will only use Euclidean norms. Hence for a point 
X G R", the symbol \x\ will denote the standard Euclidean norm of x. We let 
Be (a;) be an open ball around x of radius e, and we let 'Be{x) denote its closure. 



2.1 Tih stability 

In establishing our main result, it will be crucial to relate the notion of stable 
strong strong local minimizers to the theory of tilt stability, introduced in [13) . 
We begin with a definition [THl Definition 1.1]. 
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Definition 2.1 (Tilt stability) A point x gives a tilt-stable local minimum 
of the function /; R" — > R if f{x) is finite and there exists an e > such that 
the mapping 

M : u I— > argniin{/(a;) — {v,x)}, 

\x — x\<~e 

is single- valued and Lipschitz on some neighbourhood of with Af (0) = x. 

For smooth functions, tilt stability reduces to positive-definiteness of 
the Hessian V^f{x) [H Proposition 1.2]. We will see (Corollary [H^) that the 
notions of tilt stability and stable strong local minimality are the same for 
all Isc functions — a rather surprising result. As a first step in establishing 
this equivalence, we now show that stable strong local minimizers depend in 
a Lipschitz way on the perturbation parameters. 

Proposition 2.2 (Lipschitzness of stable strong local minimizers) 

Consider a Isc function f : R" — > R and suppose that x is a stable strong local 
minimizer of f. Then the correspondence v i-^ Xy of Definition ] is locally 
Lipschitz around 0. 

Proof There is a constant n and a neighbourhood U oix so that for any vectors 
w, w near the origin, we have 

f[Xy) > f{Xw) + {w,Xy Xjy) + K\Xy Xyj\ . 

Adding the two inequalities and dividing by \xv — we obtain 

/ V Xy -Xnj \ ^ 2^ 

\ \Xy \ ' 

We deduce \xy — Xw\ < — w\, thereby establishing the result. □ 

The following is now immediate. 

Proposition 2.3 (Stable strong local minimizers are tilt-stable) 

Consider a Isc function f : R" — R and a point x G R". If x is a stable strong 
local minimizer of f , then x gives a tilt-stable local minimum of f . 

Proof This readily follows from definition of tilt stability and Proposition [221 

□ 

The converse of the proposition above will take some more effort to prove. We 
will take this up in Section [31 
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2.2 Some convex analysis 

For any set Q C R", the symbol co Q will denote the convex hull of Q, while 
CO Q will denote the closed convex hull of Q. Consider any function / : R" — > R 
that is minorized by some afiine function on R". Then the set co(epi/) is an 
epigraph of a Isc, convex function, which we denote by co/. In some cases 
CO (epi/) is itself a closed set, and in such an instance, we refer to co / simply 
as CO /. 

For any (not necessarily convex) function / : R" — > R, the convex subdif- 
ferential of / at denoted by dcof{x), consists of all vectors v satisfying 

f{x) > fix) + {v,x- x) for all x e R". 

Equivalently, a vector v lies in dcof{x) if and only if a; is a global minimizer of 
the tilted function x i— >■ f{x) — {v, x). It will be important for us to understand 
the relationship between the convex subdifferential of a function / and the 
convex subdifferential of its convexification co /. The following result will be 
especially important. 

Lemma 2.4 |3 Proposition 1.4-3] Consider a Isc function f : R" R. Sup- 
pose that f is minorized by some affine function on R". Then we have 

{cof){x) = f{x) dco{cof){x) = dcofix), 

d,of{x)^^=^{mf)(x)^ f{x), 

^f<f- 

The following lemma shows that under reasonable conditions, the set of 
minimizers of the convexified function co / coincides with the closed convex 
hull of minimizers of /. See [3 Remark 1.5.7] for more details. 

Lemma 2.5 (Minimizers of a convexified function) 

Consider a Isc function f : R" R with bounded domain, and suppose fur- 
thermore that f is minorized by some affine function on R". Then co(epi/) 
is a closed set, and we have 

argmin (co /)(x) = co I argmin f{x)]. (2-1) 

As a direct consequence, we obtain the important observation that tilt- 
stable minimizers are preserved under "local" convexification. 

Proposition 2.6 (Tilt-stable minimizers under convexification) 

Consider a Isc function f : R" — > R and suppose that a point x G R" gives a 
tilt-stable local minimum f . Then for all sufficiently small e > 0, in terms of 
the function g := f + 5^ j.-^, we have 

argmin{/(x) - {v,x)} = argmin{(co5)(a;) - {v,x)}, 

\x — x\<e x^It^ 

for all V sufficiently close to 0. Consequently x gives a tilt-stable local minimum 
of the convexified function co (/ + (5g ^^^). 
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Proof By definition of tilt stability, we have that f{x) is finite, and for all 
sufficiently small e > 0, the mapping 

M : V 1-^ argmin{/(x) — {v,x)}, 

\x — x\ <e 

is single-valued and Lipschitz on some neighbourhood of with Af(0) = x. 
Letting g '■= f + &^ and applying Lemma 12.51 to the function x t-^ g{x) — 
{v,x), we deduce 

M{v) = argmin{g(a;) — {v,x)} — co { aigmm{g{x) — {v,x)}) = 

= argmin{co (.g(-) - = argmin{(cog)(a;) - {v,x)}, 

for all V sufficiently close to 0. The result follows. □ 



2.3 Variational analysis preliminaries 

A set-valued mapping G from R" to R™, denoted by G: R" =^ R™, is a 
mapping from R" to the power set of R™. Thus for each point x G R", G{x) 
is a subset of R™. The graph of G is defined to be 

gphG {{x,y) e R" X R™ : y £ G{x)}. 

Often we will be interested in restricting both the domain and the range 
of a set- valued mapping. Hence for a set- valued mapping F: R" =f R™, and 
neighbourhoods U C R" and V C R™, we define the localization of F relative 
to U and V to simply be the set- valued mapping F : R" =t R™ whose graph 
is {U X P") ngphF. 

For a set S' C R", the distance of a point a; to S" is 

d{x, S) — inf{|x — s| : s G S}. 

We define the indicator function of S, denoted by Ss, to be identically zero on 
S and +00 elsewhere. A central notion in set-valued and variational analysis 
that we explore in this work is strong metric regularity. 

Definition 2.7 (Metric regularity) A mapping F: R" ^ R™ is said to be 
strongly metrically regular at x for v, where v G F{x), if there exist neighbour- 
hoods U oi X and y of -D so that the localization of F~^ relative to V and U 
defines a (single- valued) Lipschitz continuous mapping. 

This condition plays a central role in stability theory since it guarantees that 
near x, there is a unique solution of the inclusion 

y G F{x), 

which furthermore varies in a Lipschitz way relative to perturbations in the 
left-hand-side. For other notions related to metric regularity, we refer the in- 
terested reader to the recent monograph fTl| . 

In the current work, we will use, and subsequently generalize beyond con- 
vexity, the following result that has appeared as [1] Theorem 3.10]. 
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Theorem 2.8 (Strong regularity of the convex subdifferential) 

Consider a Isc, convex function f : R" — > R and a point x in R" . Then the 
following are equivalent 

1- dcof is strongly metrically regular at (a;,0). 

2. There exists k > and neighbourhoods U of x and V of so that the 
localization of {dcof)~^ relative to V and U is single-valued and we have 

> f{x) + (u, a; — i) + n\x — x\^ for all x £ U, 

and all {x, v) e (U x V) H gphdcof- 

Clearly, for convex functions, property [5] in the theorem above is equivalent to 
X being a stable strong local minimizer of /. 

We now consider subdifferentials, which are the fundamental tools in the 
study of general nonsmooth functions. 

Definition 2.9 (Subdifferentials) Consider a function /: R" R and a 
point X with f{x) finite. The proximal subdifferential of / at x, denoted by 
dpf{x), consists of all vectors v G R" for which there exists r > satisfying 

f{x) ^ fi^) + {v,x — x) — r\x — for all x near x. 

On the other hand, the limiting subdifferential of / at x, denoted by df{x), 
consists of all vectors v for which there exists a sequence {xi, f{xi),Vi) — > 
(x, f{x), v), with Vi e dpf{xi) for each index i. 

The need for the limiting construction df arises due to bad closure proper- 
ties of the set-valued mapping x ^ {f{x)} x dpf{x). For smooth functions 
/ on R", the subdifferential df{x) consists only of the gradient V/(x) for each 
X G R". For convex /, the proximal and the limiting subdifferentials coincide 
with the convex subdifferential dcof{x). 

Seeking a kind of uniformity in parameters appearing in the definition of 
the proximal subdifferential, we arrive at the following [TU Definition 1.1]. 

Definition 2.10 (Prox-regularity) A function /: R" R is prox-regular 
at X for w if / is finite and locally Isc at x with v e dj{x), and there exist 
e > and p > such that 

f{x') > fix) + {v,x' ^x) - ^\x' -xl"^ for all x' S B,{x), 

when V G df{x), \v — v\ < e, \x — x\ < e, |/(a;) — f{x)\ < e. 

In relating strong metric regularity of the subdifferential df to the func- 
tional properties of /, it is absolutely essential to require the function (cc, v) t-^ 
f{x) to be continuous on gph9/. This leads to the notion of subdifferential 
continuity, introduced in [121 Definition 2.1]. 

Definition 2.11 (Subdifferential continuity) We say that /: R" — > R is 
subdifferentially continuous at x for v G df{x) if for any sequences Xi x and 
Vi —> V, with Vi G df{xi), it must be the case that f{xi) — )■ f{x). 
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In particular, all Isc convex functions /, and more generally all strongly 
amenable functions (see [121 Definition 10.23]), are both subdifferentially con- 
tinuous and prox-regular at any point x € dom/ for any vector v G df{x). 
See [m Proposition 13.32] for details. 

Rockafellar and Poliquin characterized tilt stability in a number of mean- 
ingful ways |13[ Theorem 1.3], with the notions of prox- regularity and subd- 
ifferential continuity playing a key role. The following is just a small excerpt 
from their result. 

Theorem 2.12 (Characterization of tilt stabiUty) Consider a function 
f: R" — >■ R, with G df{x), and such that f is both prox-regular and subd- 
ifferentially continuous at x for v — Q. Then the following are equivalent and 
imply the existence of e > such that the mapping M in Definition \2.1\ has 
the equivalent form M{v) = {df)^^{v)C\'Qc{x) for all v sufficiently close to 0. 

1. The point x gives a tilt-stable local minimum of f . 

2. There is a proper, Isc, strongly convex function h on R" along with neigh- 
bourhoods U of X and V of Q such that h is finite on U, with h{x) = f{x), 
and 

{U xV)r\ gph<9/ = ([/ X F) n gph9/i. 

Analysing the proof of the above theorem, much more can be said. Indeed, 
suppose that the set-up of the theorem holds and that x gives a tilt-stable 
local minimum of /. Thus there exists e > such that the mapping 

M :v ^ argmin{/(a;) — 

la: — ic| <e 

is single-valued and Lipschitz continuous on some neighbourhood of with 
Af(0) — X. Then the convex function h guaranteed to exist by Theorem 12.121 
can be chosen to simply be the convexified function 

/t = C0(/ + %^(-)). 

This observation will be important for the proof of our main result Theo- 
rem [331 



3 Main results 

We begin this section by establishing a simple relationship between tilt stabil- 
ity and strong metric regularity of the subdifferential df. 

Proposition 3.1 (Tilt stability vs. Strong metric regularity) 

Consider a Isc function f : R" — > R and a point x that is a local minimizer of 
f . Consider the following properties. 

1. The subdifferential mapping df is strongly metrically regular at (i, 0). 

2. f is prox-regular at x for and x gives a tilt-stable local minimum of f . 
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Then the implication [T] holds, and furthermore i/[T] holds, then for suffi- 
ciently small e > the mapping M of Definition \2.I\ has the representation 

M{v)^B,ix)n{df)-\v), 

for all V sufficiently close to 0. The implication^^^ holds provided that f is 
subdifferentially continuous at x for 0. 

Proof Suppose that [T] holds. Then, in particular, a; is a strict local minimizer 
of /. Hence there exists e > satisfying 

f{x) > f{x) for ah X G B^{x). 

It is now easy to check that for all vectors v sufficiently close to 0, the sets 
argmin|^_g|<;g{/(a;) — {v,x)} are contained in the open ball B^ix). Hence by 
strong metric regularity we have 

Be(S) n {df )~^{v) = argmin{/(a;) - {v,x)], 

\x — x\<.e 

for all V sufficiently close to 0. It follows from the equation above and the 
definition of prox-regularity that / is prox-regular at x for 0. The validity of 
[5] is now immediate. 

Suppose that / is subdifferentially continuous at x for and that [2] holds. 
Then by Theorem 12. 121 we have M{v) ~ 'R^{x) n (df)^^{v), and consequently 
df is strongly metrically regular at (x, 0). □ 

We can now establish the converse of Proposition l2.31 thereby showing that 
tilt-stable local minimizers and stable strong local minimizers are one and the 
same. 

Corollary 3.2 (Stable strong local minimizers and tilt stability) 

For a Isc function f : R" —5- R, a point x gives a tilt-stable local minimum of 
f if and only if x is a stable strong local minimizer of f . 

Proof The implication -4= has been proven in Proposition 12.31 We now argue 
the converse. To this end, suppose that x gives a tilt-stable local minimum of 
/. Then by Proposition 12.61 for all sufficiently small e > 0, the point x gives 
a tilt-stable local minimum of the convexified function co (/ -I- &g ^g-j), and 
furthermore, in terms of the function g f + &g (j), we have 

argmin{g(a;) — {v,x)} — argmin{(cog)(x) — {v,x)}, (3-1) 

for all V sufficiently close to 0. In light of p.ip . we have 

V e dco9{x) ^ w e dco{cog){x), (3.2) 

for all X G R" and all v sufficiently close to 0. 

Observe co g, being a Isc convex function, is both prox-regular and sub- 
differentially continuous at x for 0. Hence applying Proposition 13.11 to cog, 
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we deduce that the subdifferential dco{cog) is strongly metrically regular at 
(x, 0). Consequently by Theorem 12.81 there exists k > and neighbourhoods 
U of X and F of so that the localization of {dco{co g))~^ relative to V and 
U is single-valued and we have 

{cog){x) > {cog){x) + {v,x ~ x) + k\x — aip for all x E U, 

and aU {x, v) e {U x V) D gph9co(co g). 

Shrinking U and V, we may assume that the inclusion U C 'B^{x) holds. 
Combining (13.21) and Lemma [2.4[ we deduce that for any pair {x,v) € {U x 
V) n gphdco{cog), we have {cog){x) = g{x) = f{x), and that for any x E U 
the inequality {cog){x) < f{x) holds. The result follows. □ 

With the preparation that we have done, the proof of our main result is 
now straightforward. 

Theorem 3.3 (Strong metric regularity and quadratic growth) 

Consider a Isc function f : R" — > R that is subdifferentially continuous at x 
for 0, where x is a local minimizer of f . Then the following are equivalent. 

1. The subdifferential mapping df is strongly metrically regular at (5,0). 

2. f is prox-regular at x for and x gives a tilt-stable local minimum of f. 

3. There exists k > and neighbourhoods U of x and V of so that the 
localization of {df)~^ relative to V and U is single-valued and we have 

f{^) ^ f{i) -\- (v , X — x) -h k\x — for all x E U, 

and for all {x,v) £ {U x V) Cl gph df. 
4-. f is prox-regular at x for and x is a stable strong local minimizer of f 

Proof The equivalence IT] <J2] was proven in Proposition 13. II 

[^=»r5]: Suppose [2] holds. Then by Theorem 12 . 1 2 1 and the ensuing remarks, 
there is e > so that for the convexified function h :— co (/ + ^-■^), we have 

gph 9/ = gphdh locally around {x, 0). 

From the equivalence [1] < ^ 21 we deduce that the mapping dh is strongly 
metrically regular at {x, 0). Applying Theorem l2.8l to h, we deduce there exists 
K > and neighbourhoods U oi x and y of so that the localization of (9/)^^ 
relative to V and U is single- valued and we have 

h{x) > h{x) + {v,x- x) + n\x - x\^ for all x &U, (3.3) 

and all {x,v) £ {U xV)C\ gph 9/. Shrinking U and V ^ we may assume that 
the inclusion U C Be(a;) holds. Observe by Proposition 13. 11 we have 

argmin{/(x) - {i,x)} = B,(i) n {df)-\i), 

\x—x\<e 

for all V sufhciently close to 0. In particular, we may shrink V so that for 
all pairs (x, u) G [U x V) C\ gph 9/, we have dcof{x) ^ 0. Then applying 
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Lemma we deduce h{x) — f{x) for all {x,v) G {U x V) Ci gphdf, and 
h{x) < f{x) for all x & U. Plugging these relatfons into (I3.3p . the result 
follows immediately. 

[3] =>|3 This follows directly from the definitions of prox-regularity and 
stable strong local minimizers. 

13] This implication is immediate from Proposition 12. 31 □ 

It is important to note that subdifferential continuity plays an important 
role in the validity of Theorem 13.31 as the following example shows. 

Example 3.4 (Failure of subdifferential continuity) Consider the func- 
tion / on R defined by 



One can easily check that / is prox-regular at a; = for v = and that 
the origin is a stable strong local minimizer of /. However df fails to be 
strongly metrically regular at (0,0). This occurs, of course, because / is not 
subdifferentially continuous at a; = for v — 0. 

The following example shows that tilt stability does not necessarily imply 
that prox-regularity holds. Hence the assumption of prox-regularity in condi- 
tions [5] and S] of Theorem 13.31 is not superfiuous. 

Example 3.5 (Failure of prox-regularity) Consider the continuous func- 
tion / on R defined by 



Clearly x = gives a tilt-stable local minimum of /. Observe however {df)~^{0) = 
R and hence the subdifferential mapping df is not strongly metrically regular 
at (0, 0). Of course, this situation occurs because / is not prox-regular at x for 



Remark 3.6 In light of [T31 Theorem 1.3], we may add another equivalence 
to Theorem 13.31 namely that / is prox-regular at x for and the generalized 
Hessian mapping d'^f{x\0) is positive definite in the sense that 



Hence in concrete instances, we may use the newly developed calculus of the 
generalized Hessians [TU] and the calculus of prox-regularity [TT] to determine 
when any of the equivalent properties listed in Theorem 13.31 hold. 
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a: < 0, 
a; > 0. 




a;^0, 
x = 0. 



0. 



{z,w} > whenever z e 9^/(x|0)(u>), w ^0. 
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